Reconciling reinforcement learning models with behavioral extinction and renewal: implications for addiction, relapse, and problem gambling.
نویسندگان
چکیده
Because learned associations are quickly renewed following extinction, the extinction process must include processes other than unlearning. However, reinforcement learning models, such as the temporal difference reinforcement learning (TDRL) model, treat extinction as an unlearning of associated value and are thus unable to capture renewal. TDRL models are based on the hypothesis that dopamine carries a reward prediction error signal; these models predict reward by driving that reward error to zero. The authors construct a TDRL model that can accommodate extinction and renewal through two simple processes: (a) a TDRL process that learns the value of situation-action pairs and (b) a situation recognition process that categorizes the observed cues into situations. This model has implications for dysfunctional states, including relapse after addiction and problem gambling.
منابع مشابه
The effect of high-fat diet on extinction and renewal.
Diets high in saturated fats are linked to health problems and impairments in cognitive function in humans. Recent evidence suggests that exposure to a high-fat diet can impair rats' ability to appropriately inhibit responding to stimuli that are reinforced in some circumstances but not in others. Here, we examined the effects of exposure to a high-fat diet on the context-specific renewal of ex...
متن کاملStress before extinction learning enhances and generalizes extinction memory in a predictive learning task.
In extinction learning, the individual learns that a previously acquired association (e.g. between a threat and its predictor) is no longer valid. This learning is the principle underlying many cognitive-behavioral psychotherapeutic treatments, e.g. 'exposure therapy'. However, extinction is often highly-context dependent, leading to renewal (relapse of extinguished conditioned response followi...
متن کاملWhy are Some Games More Addictive than Others: The Effects of Timing and Payoff on Perseverance in a Slot Machine Game
Manipulating different behavioral characteristics of gambling games can potentially affect the extent to which individuals persevere at gambling, and their transition to problematic behaviors. This has potential impact for mobile gambling technologies and responsible gambling interventions. Two laboratory models pertinent to this are the partial reinforcement extinction effect (PREE) and the tr...
متن کاملExtinction Learning as a Model of Drug Treatment and Relapse: A Behavioral Overview
Extinction is the process by which a previously established stimulus relationship is broken by the removal of reinforcers and/or biologically relevant stimuli, causing a reduction in responding. Given the importance of this phenomenon in terms of understanding not only learning and behavior, but also of enhancing our understanding of drug addiction and treatment, there is renewed attention bein...
متن کاملRenewal after the punishment of free operant behavior.
Three experiments examined the role of context in punishment learning. In Experiment 1, rats were trained to lever press for food in Context A and then punished for responding in Context B (by presenting response-contingent footshock). Punishment led to complete suppression of the response. However, when responding was tested (in extinction) in Contexts A and B, a strong renewal of responding o...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Psychological review
دوره 114 3 شماره
صفحات -
تاریخ انتشار 2007